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Abstract 

In this paper we are concerned with a new type of backward equations with anticipation 
which we call neutral backward stochastic functional differential equations. We obtain the 
existence and uniqueness and prove a comparison theorem. As an application, we discuss the 
optimal control of neutral stochastic functional differential equations, establish a Pontryagin 
maximum principle, and give an explicit optimal value for the linear optimal control. 
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1 Introduction 

Throughout this paper, we fix 5 > as a positive constant. Let (J7,^,F,P) be a complete 
filtered probability space on which a d-dimensional Brownian motion {W {t)}t>o is defined with 
{■^t}t>o being its natural filtration augmented by all the P-null sets in Also we define 
'■= ^0 for all u G [—(5,0], then F := {^t}t>-5 is a filtration satisfying the usual conditions 
on [—6, +oo). 

In this paper, we investigate the following backward stochastic equation with anticipation, 

-d[Y{t)-G{t,Yt,Zt)] = f{t,Yt,Zt)dt-Z{t)dWt, t£[0,T]; 
Y{t)=m, te[T,T + S]; (I.I) 
[Z{t) = C{t), te[T,T + 6], 

where {Yt,Zt) denotes the path of the unknown processes {Y,Z) on + 5], G,f : [0,T] x 
fl X L^(0, (5;M") X L^(0, (5; M"^'^) MJ^ are given maps, and (^, C) are given adapted stochastic 
processes on [T, T + 6]. We call {G, f) the generator. Equation (jl.ip is referred to as a neutral 
backward stochastic functional differential equation (NBSFDE). It includes many interesting 
cases. 
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When G = and 5 = 0, p.ip becomes the weU-known backward stochastic differential 
equation (BSDE): 



which was first introduced by Bismut ^ for the hnear case and then extended to the nonhnear 
case by Pardoux and Peng [TT]. It has been extensively applied in mathematical finance and 
stochastic optimal control. For details, see El Karoui et. al [5ll3], Peng [12], Yong and Zhou 
[15j and the references therein. 

When G = and f{t, •, •) only depends on the value of path {Y, Z) at t and t + 6, Eq. ijl.ip 
becomes 



It is the so-called anticipated backward stochastic differential equations introduced by Peng 
and Yang [13] when they discuss optimal control of delayed stochastic functional differential 
equations. 

By an Ito type neutral stochastic functional differential equation (NSFDE), we mean the 
following: 



where X* denotes the path of X on [t — 6, t]. It is a type of retarded functional equations. This 
equation was first introduced by Kolmanovskii and Nosov [8] to model the chemical engineering 
system. Since then, many papers are devoted to the stability of the solutions. See Mao [TO] . 
Huang and Mao [3], and Randjelovic and Jankovic [13] and the references therein. 

In deterministic case, optimal control of neutral functional equations was discussed in 1960s 
and 1970s by Kolmanovskii and Khvilon [7], Kent [6J and Banks and Kent [Ij. Optimal control 
of NSFDEs seems to remain to be open. In this paper, via constructing the duality between 
linear backward and forward stochastic neutral functional differential equations, we discuss a 
simple optimal control in the stochastic case. The more general one will be discussed elsewhere. 

The rest of the paper is organized as follows. In section 2, we prove the existence and 
uniqueness of adapted solutions and some estimates of NBSFDEs. Section 3 is devoted to 
a comparison theorem. Finally, as applications, we discuss an optimal control of NSFDEs, 
construct a Pontryagin maximum principle, and obtain an explicit optimal value of a linear 
optimal control. 

2 Existence and Uniqueness Result 

In this section, we prove the existence and uniqueness for NBSFDE (jl.ip . construct some esti- 
mates of the solutions, and discuss how 5 affects the solutions in a simple case. 




' -dY{t) = f{t,Y{t),Y{t + 5),Z{t),Z{t + 5))dt- Z{t)dWt, t e [0,T]; 
< Yit)=m, te[T,T + 5]; 
,Z{t) = C{t), tG[T,T + S]. 
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First, let us introduce some spaces. Let H he a finite-dimensional space like 



pn Trenxd 



, etc., 



whose norm is denoted by | • |. Denote by SS{D) the Borel cr-algebra of some metric space D. 



\'<p{t)\^dt < +00 L 



[i) ■.[s,t]^ H \ sup < +00 1 

S<t<T J 



'i^T;H) := : n H \ ^T-measurable, < +oo|, 



^i{s, r; H) := <j X(-) : [s, r] x ^ if 
<([s,r];i/) 



F-adapted and E 



X{t)\^dt 
2 



X{-) : [s,t] X n H \ F-adapted and E sup \X{t)\ 

L S<t<T 



< +00 
< +00] 



X{-) : [s, r] X — > i7 I F-adapted with continuous path, and 



E 



sup \X{t)Y 

S<t<T 



< +00 



} 



For simplicity, define 
equipped with norm 



\\{OX)\\.^Hs,r) :-- 



E 



sup \e{t)\^+ I \x{t)\Ut 

S<t<T 



Fix 5 > to be a constant. For all (y, z) G J^^(0, T + 5), let z{t)) denote the value of 

(y, z) at time t, and {yt, zt) denote the restriction of the path of (y, z) on [t, t + S\. 
We give some conditions on the generator {G,f) of NBSFDE (II. Suppose that 

• there exist two ^{[0,T] x §2([o,5];M«) x L2(0, (5; M"'''^)) x ^T-measurable functionals 
J,F : [0,r] X X S2([o,5];Mn) x L2(0, 5; M*^^^) ^ M", such that J(-,(/7,V') and F{-,ip,%b) are 
F-progressively measurable, V(v9,V) G §^([0,5];^") x L2(0, 5; M"^'='). 

• for ah {y,z) G jr2(0,r + 5), 

G{t,yt,zt) := E[j{t,yt,zt)\^t] = Et[J{t,yt, zt)], 

f{t,yt,zt) := E[F{t,yt,zt)\^t] = Et[F{t,yt, zt)]. 
Consider the following standing assumptions on {G,f). 

{HI) There exist k G (0, 1) and a probability measure Ai on [0, 5], such that for all (y, z), (y, z) € 
^2(0, T + 6) and ah (t, 00) G [0, T] x fi, 



|G(t,yt,2t) - G{t,yt,zt)\ 



<KEt 



\y{t + n) - y(t + n) p Ai (du) + / + n) - z(t + n) f 



(2.1) 



{H2) There exist L > and two probability measures A2, A3 on [0,6], such that for all 
{y,z),{y,z) G J^'^{0,T + 6) and aU {t,uj) G [0,r] x Q, 



\f{t,yt,zt) - f{t,yt,zt)Y 



<LEt 



\y{t + u) - y{t + u)Y\2{du) + I \z{t + u) - z{t + u)\^ \i{du) 



(2.2) 
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{H3) E sup 0,0)1^ 
Lo<i<r 



< +00 and 



E 



< +00, 



where is the path of e §^([0, 5];K") or G L2(0, 5; ] 



Remark 2.1. The dependence of G and f on the path of z requirs in (|2.2|) and (j2.1|) in different 
ways. In particular, such a form G{t,yt, z{t)) is not included in (j2.ip . 

Probability measures Aj (i = 1, 2, 3) in the generator allow us to incorporate many interesting 
cases, such as 

1 



G{t,yt,zt) = —Et I y{t + u)du 



f{t,yt,zt) = Et / y{t + u)\{du)+ z{t + u)\{du) 
^Jo Jo 

and ^ 

G{t, yt, zt) = Et \g{t, y{t),y{t + 9i), [ z{t + u)du) 

L Jo 

f{t, yt, Zt) = Et [h{t, y{t), z{t),y{t + 62), z{t + ^3))] , 

where 6i > 0, i = 1, 2, 3 are constants. 

Let us introduce the definition of an adapted solution to NBSFDE (jl.ip : 

Definition 2.1. A pair of processes (Y, Z) £ ^^(0,T + 6) is called an adapted L^-solution to 
NBSFDE (dU if they satisfy (fTH in Ito's sense. 

The following theorem is devoted to the existence and uniqueness of the adapted L^-solution 
to NBSFDE (fTT]) . 

Theorem 2.1. Let {H1)-{H3) hold. Then for any pair (^,C) G J^'^{T,T + 6), NBSFDE (fTTT) 
admits a unique adapted iJ^ -solution (Y, Z) € J^f'^^O, T + 5). 
Moreover, the following estimate holds: 



E 



<CE 



sup / \Z{t)\'^dt 

<t<T Jo 

rT+5 

sup |e(i)P+ / \C{t)?ds+ sup |G(t,0, 

\t<T+5 Jt 0<t<T 



+ 



r\fit,o,\ 

Jo 



ds 



T<t<T-\ 

where C only depends on n,d,L, and k. 

Proof. Step 1. Define a subset of jr2(0,r + 5), 

j^\o,T-c,C)--={{y,z)e.^\o,T + 6) I yit) = m, z{t) = ({t), yt e [T,T + 6]] 

equipped with norm 

rT 

sup e'^*|y(t)|2 + / 

0<i<T 



E 



e^^\z{t)\'Ut 



where /3 > is a constant waiting to be determined. It is obvious that J^^(0,T;^,C) is a closed 
subset of jr2(0,r + 5). 
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For {y,z) G ^^(0,T;^,C), consider the equation 

' -d[Y{t)-G{t,yt,zt)]=f{t,yt,zt)dt-Z{t)dWt, t € [0,T]; 
< Y{t)=m, te[T,T + 5]; 
^Z{t) = C{t), tG[T,T + 6]. 

Denote Y{t) := Y{t) - G{t,yt,zt), then 



(2.3) 



Yit)=CiT)-GiT,yT,ZT)+ I f{s,ys,Zs)ds-l Z{s) dWs, t e [0,T]. 

Prom {H1)-{H3), we have 

E[\aT)-G{T,yT,ZT)\^] 

<CE 



(2.4) 



and 



<CE 
E 

<CE 
<GE 



|C(r)l2 + |G(T,0,0)j2+ / \^{T + u)\^Xi{du)+ [ \aT + u)\'du 

Jo Jo 

rT+5 

sup \m?+ m? 

T<t<T+5 Jt 



< +00 



T 



\fit,yt,zt)\^dt 

;/(t,0,0)p+ / \y(t+u)\''X2{du) + \z{t+u)\'^Xs{du) ] dt 

■T+S 











/ \f{t,0,0)\^ dt+ sup \y{t)\+ / \z{t)\^dt 

Jo 0<t<T+S Jo 



dt < +00. 



In view of the theory of BSDEs, Eq. (j2.4p admits a unique solution (y,Z) G ^2(0,T). Then 
define 

'Y{t)-G{t,yt,zt), te[0,T]; 
te[T,T + 5], 



Y{t) 



and Z{t) := ((t), t G [T,T + 5]. 

From {HI) and (-ff3) on G, we have 



E 


sup |y(t)p 


< CE 




0<t<T 





sup |y(t)r+ sup \y{t)\ + 

0<t<T 0<t<T+S 



T+S 



\zit)\'^dt 



< 00. 



Then {Y, Z) G ^^^(0, T; C) is the sohition of Eq.dlS]). 

Step 2. Define a map from ^■^(0,T;^,C) onto itself. That is, 

^:(y,z)^(y,Z) 

with (y, Z) being the solution of (j2.3p in Step 1. We prove ^ is a contraction. 

Take another pair of process (y,^) G J^^(0, T; ^, (^), and denote {Y,Z) := '${y,z). Let 
Ay(t) := y(t) - y(t), AZ(t) := Z(t) - Z{t), Ay{t) := y{t) - y{t), Az{t) := z{t) - z{t) and 
AG{t) := G{t, yt, zt) - G{t, yt, zt). Then 

AY{t)-AG{t)= r[f{s,ys,zs)-f{s,ys,zs)]ds+ f AZ{t)dW{t), tG[0,r]. 
Jt Jt 
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Applying the Ito's formula for e^*|Ay(t) - AG(i)p, we have 



e^*|Ay(t) - AG(t)|2+ r f3e^'\AY{s)-AG{s)\'^ds+ C e^'\AZ{s)\^ ds 

Jt Jt 

e^^(Ay(s) - AG(s), f{s, vs, Zs) - f{s, y„ z.)> dt 
2 ^ e^^(Ay(s) - AG{s), AZ{s)) dWis). 



(2.5) 



In view of {H2) and the Schwartz inequality, 



E 
= 2E 

<E 



[ ^e^'\AY{s) - AG{s)\'^ ds + [ e^"|AZ(s)|2 
Jo Jo 

t-T -I 

/ e^'{AY{s)- AG{s), /(s, y„ z,) - /(s, y„ z,)> 
Jo 

^ LCe^^|Ay(s)-AG(s)|2ds + ^ e^^(^|Ay(s+u)|2A2(d7x) 
+ j \Az{s+u)\^\;i{du)^ ds . 



Consequently, choosing /3 > LC, we have 

i-T 



E 



[ e'^'\AZ{s)\'^ds 
Jo 



1 



From (j2.5p . we have 



( / \Ay{s+u)\'^X2idu)+ / [Az(s+n)pA3((i'u) ) 



(2.6) 



<2E 



<E 



sup e''*|Ay(t)-AG(t)|2 + /" ^e'^'\AY{s)-AG{s)fds+[ e'^'\AZ{s)\'^ds 

0<t<T Jo Jo 

^ e^'\AY{s) - AG{s)\ |/(s, y„ z,) - /(s, y„ z,)| 

sup I / e^"(Ay(s) - AG(s))AZ(s)dW^(s)| 

<t<T Jt 

LC r e^^|Ay(s) - AG(s)|2ds 

^ L (^l^2/(^+^)l'^2(dn) + ^|Az(s+u)|2A3(du)^ 

^ sup e^*|Ay(t)-AG(t)|2 + K / e'''|AZ(s)|2(is 
K 0<t<T Jo 



+ 2E 
rT 



+ 



G 
+ E 



In view of (12.6 



(1 - j^)E 



< — —E 









sup e'^*|Ay(t) - AG(t)|2 


+ E 


r e^'\AZ{s)\^ds 


0<t<T 




Jo 



c 



j \Ay{u+s)\^\2{du) + j \Az{u+s)\^\z{duyj ds 



Then we obtain 



E 



sup e^*|Ay(t) - AG(t)| 

0<t<T 



+ E 



<9E 



e^'\AZ{s)\'^ds 
JjAy{s+u)\'^X2idu) + JjAz{s+u)\'^X3{du)^ ds 



where 6 = can be any positive constant by a proper choice of K and C. 

Since for all a, 6 G M" and Va G (0, 1), 



(a - bf > {\a\ ~ \b\f > (1 - a)a2 - (- - l)b'^ 

a 



then 



sup e^*|Ay(t) - AG(t)p 

0<t<T 



1 



> sup e^*[(l-«)|Ay(t)|^-(--l)|AG(t)|1 

0<t<T " 



1 



>(1-q) sup e^*|Ay(t)|"-(--l) sup e^*|AG(t)|^]. 

0<t<T OL 0<t<T 



(|2.7p becomes 





sup e^*|Ay(t)|2 








0<t<T 







<(--l)ii; 
a 



sup eP'\G{t,yt,zt) - G{t,yt,zt) 

0<t<T 



+ eE 



< ( — 



^ e^' ^ |Ay(s+u)|2A2((iu) + ^ |Az(s+u)|2A3(du) j 

sup e^^ ( [ \Ay{t+u)\^\i{du) + f \Az{t+u)\'^du 
<t<T \Jo Jo 



+ eE 



T 



^'i / \Ay{s+u)\^\2{du)+ / \Az{s+u)\^\:i{du)] ds 



<[(- - l)n + eT]E 
a 



sup el^^\Ay{t)\ 

0<t<T 



(2.7) 



a 



rp 

[ e'^'\Az{t)\'^ dt 
Jo 



To show that is a contraction, it suffices to prove: for any k € (0, 1), 3a G (0, 1), 6* > 0, 
such that ^ ^ 

( l)K + eT <l-a and ( 1)^ + 9 <1. (2.8) 

a a 

Indeed, for any k G (0, 1), choose a G (k, 1) and 6 small sufficiently, the above two inequalities 
is easy to hold. 

Therefore, admits a unique fixed point. That is, ()2.3|) admits a unique solution {Y, Z) G 
^2(o,r;e,C)- In view of the definition of ^^^(0, T; C), {Y,Z) G jr2(0,T + 5) and it is the 
unique adapted L^-solution of NBSFDE (fLTT) . 

Step 3. The estimation. 
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Let (y, Z) G J^'^iO, T + 6)he the solution of Eq.([n]), then 



e^*|F(t)-G(t,yt,Zt)P+ / f3e^'\Yis)-Gis,Yt,Zt)fds+ [ e^'\Z{s)\'' ds 

Jt Jt 

e^^le(T) - G(T, Yt, Zt)? + 2 e^' (y(s)_G(s, Y,, Z,), /(s, n, Z,)> 
- (y(s)-G(s,n,Z,), Z(s)> dH^(s) 



Similar to the method in step 2, for all a S (0, 1) and M > 0, 



(l-a)-E sup e^*|y(t) 

'-0<t<T 







<E 



1 



e^^|e(T)-G(r,yT,^T)|'+ / e^*|/(t,0,0)|2df + {—l)E sup e^*|G(t, y*, Zi)^ 

-I a '-o<t<T 



+ eE 



y |y(s+n)pA2(dn) + y \Z{s+u)\^\:i{du)^ ds 
<CE\eP"'(\G{TM\^+ sup + 



1 



+ / e^*|/(t,0,0)r(it +(1+M)( l)E sup e''*|G(t, 0, 0)|^ 







sup e 

0<t<T 



/3t 







<CE 



\Y{t+u)Y\i{du)+ I \Z{t+u)ydu 
5 





^'(^ / |y(u+s)|2A2(d7x)+ / |Z(n+s)|2A3((in)) ds 



Y'<t<T+S 
1 ..1 



T+S 



T 



T 



sup \m\'+ m\'dt)+ e^*|/(t,0,0)|2dt+sup e^*|G(t,0,0)|2 







0<t<T 



+ [{l + jT){—l)^+eT]E sup e^'\Y{t)\' +[(1+ ){—l)^+9]E / e^*|Z(t)pdt 



T+5 



Then, 



[{l-a)-{l + ^){--l)^-eT]E\ sup e^*|y(t)p 
Ma Lo<i<r 

+ [l-{l + ^){--l)K-e]E\ r e^^\Zis)\'ds 



<CE 



T<T<T+5 



T+5 



sup \m\''+ I m\''dt+ I e'''\fit,0,0)\'dt+ sup\G{t,0,0)\ 



0<t<T 



Similar to the argument in step 2, for any k £ (0, 1), there exist a £ (0, 1) and M > 0, such that 

(l-a)-(l + -^)(i-l)K-«T>0; 
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Therefore, 



E 



sup |y(t)r+ / \Z{s)yds 

0<t<T 



<CE 



T<T<T+5 



T+5 



T 



sup \C{t)\'dt+ \f{t,0,0)\'dt+ Slip \G{t, 0,0)\' 



0<t<T 



□ 



Remark 2.2. In (j2.ip . k G (0, 1) is essential for the existence and uniqueness. It is difficult to 
prove that ^' is a contraction for k > 1, since ()2.8p does not hold for any a G (0, 1) in this case, 

Remark 2.3. The value of Z on [0, T] is endogenous, just like BSDEs. The terminal condition 
of Z is needed for the well-posedness only on [T,T + 6'], where 6' is the forward length of the 
anticipation on Z of the generator (G, /). 

For example, if G{t, •, •) and f{t, •, •) only depend on Z{t), then the terminal condition of Z 
is not necessary. In this case, the solution Z only makes sense on [0, T]. But for the uniqueness 
of the solution in ^^(0, T + 6), we define Z = on [T,T + 6], and omit it in the equation for 
simplicity. 

Remark 2.4. (i) Since Y{t) + G{t,Yf, Zf) is path-continuous, the continuity of Y{-) depends on 
G{t, •, •). If G{t, •, •) is continuous in t, for example, 

G{t,Yt,Zt) = ^Et J^^\{s)ds , 

then y(-) is also path-continuous. 

(ii) Y{t) + G{t,Yt,Zt) is a semi-martingale with diffusion jQZ{s)dW{s). However, we do 
not know whether Y{-) is semi-martingale or not. 

Similar to the proof of the former theorem, we have the following corollary: 

Corollary 2.2. Suppose that (Giji) satisfies {H1)-{H3), and (f ,C) e J^iT,T + 6), i = 1,2. 
Consider the following NBSFDE: 

-d[Y{t)-Gi{t,YuZt)]= U{t,YuZt)dt-Z{t)dWt, t € [0,r]; 
Y{t) = e{t), t^[T,T + 5\, 
yZ{t) = C{t), te[T,T + 6]. 

Let (y*, Z*) G J^(0, T + 5) he the solution for i = 1,2, respectively. Then the following estimate 
holds: 



E 



<GE 



sup \Y\t) -Y\t)\'^ + r \Z\t)-Z\t)\'^dt 

<t<T Jo 

f-T+S 

sup \e{t)-e{t)\^+ \c\t)-e(.t)\'dt 

T<t<T+5 Jt 



(2.9) 



+ sup \G,{t,Y,\Z^)-G2{tX,Zl)\'+ [ \fi{tX,Z})-f2{tX,Z})fdt , 
o<i<r Jo 

where C only depends on n,d,L and k. 
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This corollary states the dependence of solutions on the generator (G, /) and the terminal 
conditions. In the following, we will discuss how the solution depends on in a simple case. 
Let 6i and 82 be two nonnegative constant, and 61 > 62- Consider the following two equations: 



d 



Yit) - Et [g{t, Y{t + Si))] =Et [h{t, Y{t), Z{t), Y{t + 5i))\ dt - Z{t) dW{t)- 



where 5 : [0, T] x S7 x R" ^ M", and /i : [0, T] x 1^ x M" x W'^'^ x M" ^ R" 



(2.10) 
are both adapted 



processes. 

Since both g and h are independent of the anticipation of Z(-), by Remark 12.31 it is sufficient 
for the well-posedness to give the terminal value of Y on [T, T + S\. 
Similar to assumptions {HI) and {H2), consider the assumption 
(Hi) There are k £ (0, 1) and L > 0, such that for all y, y,v,v G M" and z,z e M"^'', 

\g{t,y) -g{t,y)\ < K\y-y\; 
\h{'t,y,z,v) - h{t,y,z,v)\ < L {\y - y \ + \z - z\ + \v - v\) . 
Then we give the following proposition about the dependence of solution on 5: 
Proposition 2.3. Suppose that {HA) holds, and assume there are C > and a > 0, such that 

\g{t,y)-g{t',y)\<C\t-t'r, Vy G M", 
and for any ip,ip £ L^(=^t; I^""), 

\9{t,^) - 9{t,'p)\ < K\Et[ip - 
\Ht,y,z,(p) - h{t,y,z,if)\ < L\Et[ip - 0\\. 
Then for any € o5^j^([T, T + (5i];M"), the following estimate holds 

sup |Ay(t)p+ j \l^Z{t)\^dt 

^<t<T Jo 

<c(\6i-62\^'' + \6i-62\ + e\ sup |St[CW - 

^ ^t,t£[T,T+5] 
Particularly, if is a martingale, then 



E 



E 



sup |Ay(t)|2+ / \AZ{t)\'^dt 

0<t<T Jo 



< C \\5i - 52r + \5i 



Proof. It is obvious that ()2.10p admits a unique pair of solution {Y^, Z*) for i = 1,2 respectively. 
Let Ay := Yi — Y2 and AZ := Zi — Z2- In view of ()2.9p . we have the following estimate: 



E 
<CE 



sup \AY{t)\' + / \AZ{t)\^dt 

0<t<T 



sup \g{t,Yi{t + 5i)) - g{t,Yi{t + 62))^ 

0<t<T 



(2.111 



+ / \h{t,Yi{t),Zi{t),Yi{t + 5i))-h{t,Y^{t),Zi{t),Yi{t + 52)\^dt 



<CE 



sup \Et[Yi{t + 5i)-Yi{t + 52) 

^0<t<T 
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Then 



If t + (5i > T, t + 52>T, then 

l^;^ [Yi{t + 5i) -Y^{t + 82)] \^=\Et [iit + 61) - at + S2)] I' 
<Et\ET[({t + Si)-at + 62)]\'' 

<Et\ sup \ET[as)-mf ■ 

s,se[T,T+S] ^ 

Iit + Si>T, t + S2<T, then T - {t + 62) < {t + Si) - {t + 62) = Si - 62, 

Et [Yi{t + <5i) -Yi{t + 62)] = Et [at + Si) -Yi{t + S2)] 

: E, \at + Si) - e(T) + [g{T, e(T + <^i)) - g{t + ^2, C(i + ^2 + Si))] 

r 

h{s,Yiis),Zi{s),Yi{s + Si))ds . 

\Et[Yi{t + Si)-Yiit + S2)]\^ 
< C (\Etm + Si) - e(T)]|2 + \Et[g{T, ^(T + Si)) - git + 52,C(i + ^2 + Si))]\' 

+ {T-t-S2)Et \ r \h{s,Yi{s),Zi{s),Yiis + Si))\^ds\) 

< c (Et [\ETUt + Si) - e(r)]|2 + \EtUT + Si) - i{t + Si + S2)\f 

+ \Sl-S2\'"' + \Sl-S2\) 

<c{Et\ sup \ETUs)-m]?\+\5i-52?'" + \5i-S2\). 

^ ^s,se[T,T+S\ ^ 

If i + (5i < T, then 

Et[Yi{t + Si)-Yi{t + S2)] 
= Et [g{t + Si,Yi{t + 2,5i)) - g{t + S2,Yi{t + S2 + Si))] 



+ Et 



t+62 



h{s,Yi{s),Zi{s),Yi{s + Si))ds 



and 



\Et[Yi{t + Si)-Yi{t + S2)]t 



< 



Et 



g{t + Si,Yi{t + 2,5i)) - g{t + S2, Yi{t + S2 + Si)) 



+ \S1-S2\Et 



t+5i 



t+S2 



\his,Yi{s),Zi{s),Yi{s + Si))fds 



< c(\Si - Jsp" + \Et[Yi{t + 2Si) -Yi{t + Si + S2)]\^ + |<5i - S2\) 
<■■■ <c(\Si-S2\^" + \Si-S2\+Et\ sup |^T[C(s)-e(^)]pl). 

^ ^s,se[T,T+5] 



So we obtain 

E 



sup \Et'^i{t^Si)-Yi{t^S2)]Y 

0<t<T 



<c(\Si-S2\'''' + \Si-S2\ + Et\ sup |£;T[e(s)-e(s)]pl), ViG[o,r]. 

^ ^s,selT,T+S] 
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Applying (|2.1ip . then 

e\ sup |Ay(f)|2+ [ \AZ{t)\'^dt 

^0<t<T Jo 

<c(\6i-62\^'' + \6i-52\+Et\ sup lErim - 

^ ^s,se[T,T+S] 

If C(-) is a martingale, then EriCit)] = C(T), 



sup |Ay(t)|2+ / |AZ(t)|2(it < -(^2r + |(^l -(^2|). 

0<t<T JO 



□ 



3 Comparison Theorem 

In this section, we are going to establish a comparison theorem for the adapted solution of 
NBSFDEs when G is independent of Z and / depends on Z without anticipation, i.e. 



-d[Y{t)-G{t,Yt)] = f{t,Yt,Z{t))dt-Z{t)dW{t), te[0,T]; 
Y{t)=m, te[T,T + 6]. 



(3.1) 



In view of Remark 12.31 we omit the terminal condition on Z, and treat Z = on [T,T + 5]. 
Here we suppose that n = 1, d > 1. 

Both assumptions (HI) and {H2) on (G, /) are reduced to the following: 

{H5) For any {y, z), {y, z) e J^\0,T + 6), 



\Git,yt)-G{t,yt)\' <KEt / \y{t + u) - y{t + u)\' Xi{du), 

Jo 



\f{t,yt,z{t))-f{t,yt,z{t))\ < LEt / \y{t + u) - y{t + u)\' X2{du) + \zit) - zit)\' 

where k, L, Ai and A2 are the same as in (HI) and {H2). 
Let us first consider the simple case: 

( - d [y{t) - g{t)] = [fit) + m^it)] dt - z{t) dW{t), t e [0, T], 

\y{t) = q eL2(^r;K). 

We have the following lemma: 



(3.2) 



Lemma 3.1. Suppose that Q > 0, g{T) = 0. Then for any (3 £ .if^(0, T; M), and nonnegative 
g G y^{0,T;R) and f € ^^{0,T;R), we have almost surely y{t) > 0, G [0,r]. 

Proof. Define y{t) = y{t) — g{t). Then 

yit) = Q+ r [f{s) + f3is)zis)] ds- r z{s)dW{s). 
Jt Jt 

Since Q > and f{s) > 0, In view of the comparison theorem of BSDEs, we have y{t) = 
y{t)-g{t)>0,i.e. y{t)>g{t)>0. □ 
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Now, we have the following comparison theorem. 

Theorem 3.2. Suppose that {H3) and {H5) hold for {fuGi), and C e yf{[T,T + 6];W), i = 
1, 2. Let (y*, Z*) be the solution of the following NBSFDE, i = 1,2 respectively: 

( -d[Y\t)-G^{t,Y;)]=f,{t,Y;,Z\t))dt-Z\t)dWit), t<T; 
\Y\t)=eit), tG[T,T + 6]. 

Suppose that Gi{T,£jp) = {i,j = 1,2), and both f2 and G2 are nondecreasing in the path ofY. 

ife{T)>eiT), 

Gi{tX)>G2{tX) (^rid f,{tX,Z\t))>f2{t,Y,\zHt)), 
then we have almost surely Y^{t) > Y'^{t) for all t £ [0,T]. 
Proof. In view of Step 1 in Theorem 12.11 the following equation 

r -d[Y^{t)-G2{t,Yt^)]=f2{t,Yt\Z^{t))dt-Z^{t)dW{t), t<T; 

[Y'{t)=e{t), te[T,T + 6] 

admits a unique pair of solution {Y^, Z^). Define AgY := Y^ - Y^ , A3Z := Z^ - Z^, AG{t) := 
Gi(i,y/)-G2(t,y/), 

Af{t) := /i(t,y/,Zi(t)) - f2it,Y,\z\t)) > 0, 

and 

n... m,Y,\zHt)) - f2it,Y,\z^{tm3Z{t) ^ 

|A3Z(t)|2 h\^-szit)\m- 



We have AG{t) > 0, Af{t) > 0, /3 G ^p~(0, T; M°'), and 
A^Yit) - AG{t) 

= Ai{T) + [fr{sX^Z\s))- f2{s,Y},Z^{s))]ds- A^Z{s)dW{s) 

=Ae(T)+ r[Af{s) + p'^{s)A^Z{s)\ds- r A^Z{s)dW{s). 
Jt Jt 

In view of Lemma EH we have almost surely A^Yit) = Y'^{t) - Y^{t) > 0, Vt € [0,T]. Since 

both G2 and /2 are nondecreasing in the path of Y, then 

G2{t,Y,') > G2(t,y/) and f2{t,Yt\-) > f2{t,Y^\-). 
The following equation 

r -d[Y\t)-G2{t,Yj')]=f2{t,Yi,Z\t))dt-Z\t)dW{t), t<T; 
\Y\t)=e{t), tG[T,T + S] 
has a unique pair of solution (y^, Z^). Define A4y := Y^ — y^, A4Z := Z^ — Z^, then 
A,Y{t)-[G2{tX)-G2(.t,Y-^)] 

= (^f2{s,Y},Z^{s))- f2{s,Y!,Zi{s)))ds- A^Z{s)dW{s) 

(f2is,Y,\Z3{s)) - f2{s,Yf,Z^{s)) + f2{s,Yf,Z^{s)) - /2(s,y/,Z4(s))) ds 

T 

AiZ{s)dW{s). 
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Similarly as in the preceding paragraph, we have almost surely AiY{t) = ¥3(1) — ¥4(1) > 0, Vt G 

[o,r]. 

For any integer n, the following equation 



r - d[Y^{t) - G2{t,Yr')] = f2{t,Yr\Z^{t))dt - Z^it)dW{t), t<T; 
\Y^{t)=e{t), te[T,T + S] 

admits a unique pair of solution Similarly, we deduce almost surely 

Y^{t) > Y^{t) > Y^{t) > ■■■> y"(t) >■■■ ,yte [o,T]. 

In view of Steps 2 and 3 of Theorem 12. H there exists /i G (0, 1) such that 

3^*|A„y(t)|2+ 

0<t<T 



E 



sup e^*|A„y(t)|2 + / e^*|A„Z(t)|2di 

<t<T Jo 

sup e^*|A„_iy(t)|2+ r e^'\An-iZit)\^dt 

<t<T Jo 

sup e^*|A3y(t)|2+ r e^'\A3Z{t)\'^dt 

<t<T Jo 

sup e^^|AG(t)p+ r e^'\Af{s)\^dt 

0<t<T Jo 



< ■ ■ ■< fi'^'^E 



That is, (y", Z")„>i is a Cauchy sequence in J^'^{0, T + 6). 

Let n go to infinity in Eq. (j3.4p and compare it to Eq. (jS.Sp . we have 



0. 



(3.4) 



(y", z") ^ (y2, z^), in jr2(o, r + 5). 

Then we have almost surely Y^{t) > Y'^{t), Vt G [0,r]. 

□ 

4 Application in Optimal Stochastic Control 

As an application of the previous result, we discuss optimal control of simple neutral stochastic 
functional differential equations (NSFDEs) in this section. 

Here we only discuss the optimal control of NSFDEs with a special form as follow. The more 
general one will be discussed in the future. Let n = 1 and d > 1 for simplicity, 

d X{t)-K X{t-r)ni{dr) =b{t,X{t), X{t-r)n2{dr),u{t)) dt 
Jo J Jo 

c{t,u{t))X{t) - K [ c{t-r,u{t-r))X{t-r)ni{dr)\ dW{t), t G [0,r]; ^^'^^ 
Jo ^ 

Xit) = ipit), tG[-(5,0], 
where /ii and fi2 are two probability measures in (0, 5], k G (—1, 1) is a constant, and 
6 : [0, T] X X M X M X ^ M, and c : [0, T] X X M™ ^ M'^ 
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are jointly measurable, and b{-,x, y, u) and c{-,u) are F-progressively measurable for all (x, y, u) G 
The cost functional is defined as follow: 



J{u{-)) :=E 



l{t,X{t),u{t))dt + M{X{T)) 



are jointly measurable, and l{-,x,u) is 



where Z : [0, T] x J] x M x ^ M and M : 17 x M - 
F-progressively measurable for all (x, n) E M" x M™. 
We introduce the following assumptions: 

(H6) •,-,•), c(i, •), l{t,-,-) and M(-) are continuously differentiable in {x,y,u) with 
bounded derivatives. 

Let U C be a nonempty bounded subset. Define the admissible control set 



:= |ii : [— 5, r] X — )• [/, F-progressively measurable | u{t) = 0, Vt G [— (5, 0)|. 



In view of the conclusions in [9], Eq. (|4.ip admits an unique solution X{-) G ^S^p ([— (5, T]; M) for 
ah ti(-) G and 99(-) G S([— 5, 0];M). Thus the cost functional is well-defined. 

Our optimal control problem can be stated as follow: 

Problem(C): Find a control process u{-) G ^ such that 

J{u{-)) = sup J(n(-)). 

Then u{-) is called the optimal control, and (X(-),n(-)) is called the optimal pair with X{-) 
being the solution of Eq. (|4.ip corresponding to u{-). 



4.1 The Pontryagin maximum principle 

In this subsection, we construct the Pontryagin maximum principle for the former optimal 
control problem (C). 

At first, we establish the duality between linear NSFDEs and linear NBSFDEs, which is 
crucial in the solution of optimal control problem. 

For all t G [0,T], consider the following linear NSFDE: 



d 



X{s)-K Xis-r)ni{dr) = p{s)X{s) + q{s) Xis-r)n2idr) + /(s) 
Jo -I L Jo 

5 

+ ' 



ds 



j{s)X{s)+p{s)-K / {v{s-r)X{s-r)+p{s-r))fii{dr) dW{s), s e [t,T]; (4.2) 
Jo 



X{t) = x; 
lX{s) = 0, se[t-6,t), 

and the hnear NBSFDE 



d 



Y{T) = 
[Y{s) = 0, se{T,T + S], 



Y{s) - kEs / Y{s+r)pi{dr) = p{s)Y{s) + Es q{s + r)Y{s + r)fi2{dr) 



+ v{s)Z{s) + his) ds- Z{s)dW{s), se[t,T]; (4.3) 
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where x e M, ^ € L^(^t;K), P,q & ^p~(0,T;M), v e ^^{-5,T;W), f,he ^^{0,T;R), and 

Then we have the following lemma. 

Lemma 4.1. Suppose that p{s) = for all s < t. Let X and Y be solution of Eq. l\'i.2\i and 
■£'(/. (j4.3p . respectively. Then 



Et 



iX{T)+ h{s)X{s)ds 



xY{t) + Et 



f{s)Y{s)+p{s)Z{s))ds 



Proof. 



Etj^^d{ [Xis) - K j\{s-r)pi{dr)\ 



■-Et 



+ 



■-Et 



T f-S 
Y{s)d X{s)-K I X{s-r)pi{dr) 
t L Jo 

+ / d\x{s)-K I X{s-r)pi{dr)\dY{s) 
Jt ^ Jo ^ 

T , fS 



T ^ 



X{s)-K / X{s-r)pi{dr) dY{s) 




({p{s)X{s) + q{s) jx{s-r)p2{dr))Y{s) + f{s)Y{s))ds 



+ Et 


+ Et 


= Et^ 


I 


~^ J 




~^ J 




= Et 





T 



X(s)dF(s) 



T i-S 

K / X{s-r)pi{dr)dY{.s) 



T 



vis)X{s)+pis)-K {vis-r)X{s-r)+p{s-r))pi{dr))dW{s)dY{i 
t ^ Jo ' 



X{t) q{.s)Y{.s)+Es q{s + r)Y{s + r)p2{dr) 







ds 



+ 



T-5 



X{s)d K / Y{s+r)pi{du) 



v{s)X{s)+pis))dW{s)d Y{s)-K Y{s+r)pi{dr) + / f{s)Y{s)ds 





X{s)h{s) ds-K [ X{T-r)pi{dr) ^ + / ( f{s)Y{s) + p{s)Z{s) ) ds 
t Jo Jt 



And also 



(4A) 



Et 



X{s)-ti X{s-r)pi{dr) Y{s) 
Jo 

X{T)- K j^X{T-r)pi{dr)]i -xY{t) 



In view of ()4.4p . we obtain the conclusion. 



□ 



Then we introduce the Pontryagin maximum principle of the optimal control Problem (C). 

Theorem 4.2. Suppose that {H6) holds and U is convex. Let {X{-),u{-)) be the optimal pair. 
Define 

bx{t) ■.= b^it,X{t), [ X{t-r)p2idr),u{t)), 
Jo 
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by{t) ■.= by{t,X{t), / X{t-r)fi2{dr),u{t)), 



bu{t) ■.= bu{t,X{t), / X{t-r)fi2idr),u{t)), 
Jo 

lx{t) := l^{t, X{t), u{t)), lu{t) := lu{t, X{t), u{t)). 

where by denotes the derivative of b on the third variable. Let Y{-) satisfy the following equation: 

-d\Yit)-KEt [Y{t + r)fii{dr)\ = \b,it)Y{t) + Et [ by{t+r)Y{t + r)fi2{dr) 
L JO ^ Jo 

+ c{t,u{t))Z{t) + l^{t) \ dt- Z{t)dWit), t e [0,r]; 

Y{T) = M,{X{T)y, 
[Y{t) = 0, te{T,T + 6]. 

Then we have almost surely 

[bu{t)Y{t) + Cu{t, u{t))X{t)Z{t) + lu{t)] {u - u{t)) < 0, Vn € U. 

Proof. Since U is convex, for all u(-) € 

u%-) =eu{-) + (1 -e)n(-) G . 

Let X^ and X be solutions of Eq. (j4.ip corresponding to u^(-) and u{-), respectively. 
Define 

AX%t) := ^'^^^~^^*\ Au{t) ■.= u{t)-u{t), 



Xit) - K / x(t-r)/ui(dr) = b^{t)x{t) + by{t) / xit-r)fi2{dr) + 6„(t)An(t) 



c{t,u{t))x{t)+e{t)-K [c{t-r,u{t-r))x{t-r)+e{t-r)]iJL2{dr) dW{t), tG[0,r]; 



then AX^ converges to x in ^^(["f^i 0], M), where x satisfying 



d 



+ 

with e{t) := Cu{t,u{t))X{t)Au{t). 

From the preceding lemma, we have 

J{u{-)) - J(n(.)) 



dt 



> 



E 

■E 
■ E 



e 

^ l{t,X'{t),u'{t)) - l{t ,X{t),u{t)) ^ M{T,X^{T))-M{T,X'{T)) 







e 



T 



lx{t)x{t) + lu{t)Au{t)] dt + M^x{T) 



buit)Au{t)Y{t) + 9{t)Z{t) + luit)Au{t)j dt . 

So we have almost surely 

[K(,t)Y{t) + Cu{t, u{t))X{t)Z{t) + lu{t)] {u - u{t)) < 0, € U. 



□ 
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4.2 The optimal value 



In this subsection, we discuss the state-hnear case, and construct an exphcit expression of its 
optimal value via the comparison theorem. 

Let U be any nonempty subset of M™. For ah t € [0,T], consider the following linear 
controlled system: 



d 



X{s)-K X{s-r)fii{dr) = [a{s,u{s))X{s) + b{s,u{s)) X{s-r)fi2{dr)]ds 



+ 



c{s,u{s))X{s) - K c{s-r,u{s-r))X{s-r)fii{dr) dW{s), s € [t,T]; (4.5) 



Xit) = 1; 
[X{s)=0, se[t-5,t), 

where k G [0,1) is a constant, a{-,u),b{-,u) G ^j?°(0,T;M+) and c(-,n) G Sf^{-6,T;] 
Vn G U. 

The cost functional is also linear: 



j{ui-m = Et 



l{s,uis))X{s)ds + MX{T) 



where M G L2(^r;M), and l{-,u) G ^|(0,r;M), Vn G U. 

For all t G [0,T], the dynamic optimal control problem is the following: 
Problem (CI) Find a control process u{-) G ^ such that 

J(n(.))(t) = esssup J(n(-))(t). 

n{-)Gf/ 

y(t) := J{u{-)){t) is the optimal value of Problem (CI). 

In view of Lemma 14. H if is the solution of the following linear NBSFDE: 



y"(s)-KS, / y"(s+r)/ii((ir) = a(s,u(s))y"(s) + c(s,u(s))Z"(s) + /(s,n(s)) 



d 



+ Es b{s+r,u{s+r))Y''{s+r)fi2{dr) ds - Z{s) dW{s), s G [t,T]; (4.6) 

Y'^iT) = M; 
[Y{s) = 0, se{T,T + 6], 

then y«(t) = J(n(-))(t). 
For all u G define 

r (s, y(s), y„ Z(s)) := a(s, u{s))Y{s) + c(s, n(s))Z(s) + l{s, u{s)) 

r.<5 



6(s+r, u{s + r))Y{s+r)fj,2{dr) 



Then we have the following proposition which gives an explicit expression of the optimal value 
of problem (CI). 
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Proposition 4.3. For all {y,z) G je^{0,T + 5), set 



f{t,y{t),yt,z{t)) = esssupf''{t,y{t),yt,z{t)), 

Then the NBSFDE 

- d[Y{s) - kEs !Y{s+r)iii{dr)] = f{s, Y{s),Ys, Z{s)) ds - Z{s) dW{s), s G [t, T]; 

(4 7) 

Y{s) = Q, se{T,T + 5] 
admits a unique adapted solution (Y, Z) G J^^(0, T + 6), and Y{t) = V{t). 

Proof. Applying Theorem 12.11 it is obvious that Eq. (j4.7p admits a unique pair of solution 
{Y,Z) G J^^{0,T + 6). 
For all ti(-) G ^, 

f{t,Y{t),Yt,Z{t)) > r{t,Y{t),Yt,Z{t)). 
In view of Theorem 13.21 for all n(-) G we have almost surely 

y(t)>y"(t), vtG[o,r]. 

For all e > 0, choose an admissible control u^{-) G , such that 

fit, Yit),Yt, Zit)) < f^\t, Yit),Yt, Zit)) + e. 
Applying Corollary 12.21 we have 

E[ sup ^0, ase^O 

0<t<T 



Therefore, 



Y{t) = esssup J(n(-))(t) = V{t). 



□ 



Remark 4.1. The controlled NSFDEs we consider here is of a special form in which the dif- 
fusion has a similar form as the left side of the equation. The limitation is due to the duality 
representation of Lemma 14.11 The optimal control of more general NSFDEs is still open which 
will be discussed in the future. 
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